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ABSTRACT ' ' 

Presented is an overview of the 1979 Illinois' 
tfnven+oyy of Educational Progress (HEP) for eighth-grade , * 
mathematics* The HEP is a systematic effort v by, the Illincis State 
Board of Education to collect information on the educational 
achievement of Illinois students in certain areas and tc, nake that, 
information available to educational "decision-makers* Ihe lilt 
employs an ob jective&ref erenced approach, with* desir'ed^student „ 
performance expressed in terms of objectives. Students to be tested 
ase selected in a two-stage random sampling method.. Since ±he ii-EP is 
v geared towards determining how groups of Illinois students perforin on 
giyen tasks, no individual student/ teacher,, school, cr district is 
identified-. As part of the study, teachers of participating students 
were asked to estimate the percentage 'of students whc wculd obtain 
correct answers to individual t^st items.* Of fiive objectives 
containing three 'or more items*, teacher estimates *€re higher than 
studenr performance in a%l pases,' but the difference lias only 
statistically significant for one <o<b jectdve,. (MP) 
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. • f OREWORD 

c 



The 



What follows is desigried!*to provide an overview of the v 1979 Illinois 
Inventory of Educational Progress (HEP) in eighth grade mathematics, 
test has been administered by the Illinois State Board of Education since 
1976; however, this analytical report is in a new and more usable format. 

Development of the HEP is discussed, and results and analyses of the test 
administered to eighth grade students are presented. Results and analyses 
of fourth and eleventh grade tests can be found in separate reports. It Is 
hoped that the information contained here will. enhance instruction In 
Illinois, schools; 

While many state staff members contributed to the preparation 'of this 
report, I would like to especially acknowledge the efforts -of 
Dr Mervin M. Brennan as the -main -writer. . Any questions concerning this* 
report may be addres'sed to l)r. Brennan or Dr. Thomas Ker.ins, Manager of the 
Proqram Evaluation and Assessment Section of the Department of Planning, 
Research and Evaluation of- the Illinois State Board of Education. 




Donald G. Gill 

State Superintendent of Education 
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PREFACE 



Purpose :■ 

.The Illinois Inventory of Educational Progress, (HEP), is a systematic effort 
by the Illinois State Board of Education to collect information on the 
educational- achievement of Illinois students in certain areas and to make . 
that information availabte to. educational decisiqn .makers. 

The three goals of the 'HEP are: < » 

* « . * * * 

1) to make aval laW e relevant, reliable, and valid data on the educational 
attainments *of Illinois, students'; , * . 

2) to identify any trends (growth, stability, or decline)' in educational , 
attainments which occur over time; and * 

3) to publish results 'of the research condllcted in connection with the HEP, 
Studeat Selection > . ( \ 

i 

A random sample with two sampling stages is used to select those students 
attending. Illinois public schools who will participate. 

First' schools 'throughout the state are chosen randomly. A sample of 
fourth eighth, and eleventh' graders. is then randomly selected from lists of 
el-igible students submitted by schools for participation. These grade 
levels are selected to correspond roughly with .the, end of the primary, v 
elementary, and secondary .levels of education. # » 

Since th*e HEP is geared toward determining how groups of Illinois students 
perform on given tasks, no individual student, teacher, school, or district 
is identified in any reports of -the results. . ^ 

Type of Test - < * 

The HEP employs an objective-referenced approach. An objective-referenced 
assessment instrument assesses student performance. Desired studeny 
performance' is expressed in 'terms of "objectives. 'An objective isa/ 
statement of desired studenl performance, for example: "Fourth grade 
students' should be' able to recognize geometric shapes such -as circles,, 
etc." -Student performance is measured by test items designed to determine 
whether or not certain groups of students are able to do what the objectives 
state they should be abje to do. '. ... 

Sub.iect Areas ( 

The HEP has been-in existence since 1976. "A number of subject areas have 
been assessed, for example, reading, mathematics, science, citizenship, 
energy and .nutrition, as well as student attitudes about themselves, and 
education in general.- * J 

Base line data is collected during the first year that any ^subject area is 
assessed. For each, succeeding year that a subject area is- reassessed, 
comparisons can be Jiiade concerning student- performance, on specific 
objectives, and any growth or decline in achievement can be noted. t 
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CHAPTER 1 



Illinois; Inventory of Educational Prdg^ess - Mathematics 

Development of the 1979, Mathematics HEP - , > *J . 

In the sprang of 1978,' a panel of six. mathematics educators with elementary, 
'junior high, high school and college teaching and administrative experience 
was convened to assjst State Board^staff in formulating the 1979 mathematics 
HEP (a roster of panel members appears in Appendix D). Charged with 
redrafting the objectives which had been developed for the 1976 HEP, the 
group met over a two-month period.. The results of their work are discussed 
later 1n this report. . * » m 

Additionally, results of a teacher surve/that was adninis teredo with the 
previous year's HEP (1978) were used in developing the 1979 mathematics 
IIEP. Produced by State Board staff, the survey sought/ to: \(1) validate 
'the test; (2) supply an additional perspective on the results; and (3) 
provide a standard af performance, based upon teacher estimates, with which 
student results, coufd be comparedL_ 

*> 

Toward that end, one mathematics teacher from each school which participated 
in the HEP was asked to do three things for ..each test item. Teachers were 
asked to determine (1) whether students jiad been exposed to the material and 
£2) whether the item was. of an appropriate level of difficulty. Teachers 
were also Jr'sked (3) to estimate the percentage of "students that cbuld^be * 
expected to answer each item correctly. " A sample of the teacher survey is 
contained in Appendix C. Results of the teacher survey , are discussed in 
Chapter 2. - 

' The Test - , 1 

The test was a domain and objective-referenced test, which means simply tha 
•the items tested the general domain of mathematics and that items are 
derived from or keyed to a set of currteular objectives. 

Mathematics objectives for the 1979 HEP were developed by the 
aforementioned panel ©fornicators. The following mathematics topics and 
abilities reflect those objectiyes. A list of topics precedes a summary 
description of abilities. Some of the topics are self-explanatory; a brief 
definition is provided for those which are less common. The abilities are a 
bit more detailed; essentially, 'they are the skills required" for success -in^ 
mathematics. Each mathematics objective describes a particular ability with 
reference to a specific topic. « ^ 



Mathematics Topics - - 

* 

I. NUMERATION' CONCEPTS. This topic refers to the concepts of , 4 

numeration and place v&lue, and the processes of naming numerals, , 
approximating numbers, and rounding off numbers, 
i * * 

> TI. PROPERTIES OF NUMBERS AND OPERATIONS. This' topic also includes 
characteristics 'of* numbers and operations and comparisons among 
numbers. 

III. NUMBERS. 

A. - WHOLE NUMBERS.' Whole numbers arethe numbers used by children 

to count. Whole numbers include 0, 1, 2, 3, etc 

B. • FRACTIONS. . • . ' * ~~ 



. > 



C. DECIMALS.. 

D. - PERCENT. . 

' E. INTEGERS. Integers are positive and -negative whole numbers 

and zero as distinguished, from, fractions. The numbers -3", -2, 
-1, 0, +1, +2, +3, etc., are integers. 

F. RATIONALS. Rationals is an all-inclusive term for topics' A 
through E, both positive and negative. Examples are +2, +1/2, 

* +.'50, +50%, -2, -1/2, -.50, and -50%. 

G. REALS. Reals- is an .aKI-inclusive term for topics A through F 
f and numbers such as s jf , V;H etc * 

IV. MEASUREMENT. s * 

• V. ALGEBRA.. **T 

VI.' GEOMETRY. - - * 

• 

VII. PROBABILITY AND STATISTICS. 

- • 

VIII. PERSONAL AND -CONSUMER MATHEMATICS. \ 



Mathematics Abilities 

1. Ability to recall "and recognfze facts/ definitions, and symbols 
quickly. Perception is the primary mental act used. 

2. Ability to perfdrm computations,' procedures, and complex counting 
where the operations <are indicated. 

, 3. 'Ability to understand concepts, facts, and processes'. The mental 
' operations of analysis and synthesis are used to make comparisons - 
and evaluative ju^gmei fts^ 



4. Ability to solve complex word problems. Several of the following 
operations must be involved: interpretation of the question; 
identification of the relevant data from the g^jven information, 
• decisions about which operations need to be performed on the data, 
correct performance on the operations, and, interpretations of the 
results. ; _' v 

'Each mathematics item tested a student abllitytfith respect to one of the 
mathematics topics. The matrix of mathematics topics and abilities (Table 
1) shows the conceptual model of the % HEP mathematics tests. Each cell of 
the matrix is a specific mathematics objective. 

The test contained items on seven topics and .four abilities. There were " 
items related to 19 objectives wtthin the^topics and abilities. A topfrp" - 
ability, or objective was considered to be measured if -ther^-were three or v 
moje items testing it. By that standard, -the test measured five topic* and 
three abilities; and five objectives within ^them. The test is* described 
more fully in subsequent chapters- of this report. 



ERLC 



-3- 



8 



Table 1 

MATRIX OF MATHEMATICS OBJECTIVES 
MATHEMATICS 'CATEGORIES BY ABILITIES 



Mathematics Topics 

I. NUMERATION CONCEPTS 
II. % PROPERTIES 'OF NUMBERS 

?AND OPERATIONS 

III. NUMBERS. 

A. WHOLE NUMBERS 

B. FRACTIONS 

C. DECIMALS - , 
' D. PERCENT 

E. INTEGERS 

F. RATIONALE 

G. REALS 

IV. .MEASUREMENT * 



VII, 
VIII. 



1 

Ability to 
recall and • 
recognize facts; 
definitions, and 
symbols quickly 



V. -ALGEBRA 
VI. GEOMETRY 

PROBABILITY AND 
STATISTICS 

PERSONAL AND CONSUMER 
MATHEMATICS 



* The numerals (4, 8, 
1979 HEP. 



1' 
9 

T3 

n 

21 

IS 

?9~ 
33 

37 

41 

"49 

53 



*4 

4, 8 



4 

8 



4, 8' 

11 • 

8 



Mathematics Abilities 
2 - 3 



Ability to 
perform ' 
computations, 
procedures, and 
complex counting 
where the 
operations are 
indicated 



2 
6 



10 

•14" 

n 

.22 
IS 
W 
3? 

£ 

42 

50 
54 



4, 8, 11. 
11 • 
8 
8 

4, 8 
11 



8, 11 
8, ir 



11 

4, 8 



Ability to 
understand 
concepts, 
facts, and 
processes 



) 



3 

7 . 

11 
T5 
T9 
23 
Tf 
3T 

M 
39 

43 
3Z 

II 

55' 



8 
.4 



8 
11 



11 



8 



'8, n 



Ability to 
solve complex 
word problems 



4 

8 8 



12 



I 
24 

IS 

37 

36 

40 

44 
M 

52 



8, 11 
8, 11 



'4, 8 
11 

11 



U) indicate' the grade level (shat which these-items were 



56- 4, 8, 
tested in the 



Chapter 2 



ITEM RESULTS 

' . . . \ 

As mentioned in Chapter 1, teachers of participating students were asked to 
estimate the percentage of students who would obtain the correct answers to 
the items. . The hypothesis. was that the teacher estimates would be higher . 
than the student scores. Chapter 4 shows the statistical results.' 

1^ was anticipated that there would be some discrepancies tetween teacher . 

estimates and student scores Nyhich could'not be submitted. to statistical 

tests or would not' reach significance levels, but would lend themselves to 
suggestions for future research. After statistical analysis of the data, 
Experienced Illinois mathematics educators were asked ^to comment on the 

results. « * * 

The following descriptions were used for discrepancies between teacher 
estimates and student scores: < 



approximating for discrepancies of ten or less percentage points, 
higher than/lower than for discrepancies of 11 to 20 points, ancj 

considerably higher than/lower, than for -discrepancies of more than 
20 points. 

These discrepancy guidelines were established because consultants suggested 
the use of consistent standards. Ten percentage-points was used since 
standard deviations for previously calculated data were usually near .10. 

the panel of mathematics educators was asked to analyze and interpret the 
test results using the test data and the teacher survey data. They 
reflected upon the data for each curricular topic and each objective within 
the topics. * Thjs. chapter gives the data^nd the panel's comments.. Correct 
answersare underlined. Teacher estimates are abbreviated, te^ach. est. , 
student scores are abbreviated as stu. score ., ♦ V 

x * * — ~~~~~ "**""" ~~~~~ * % 

The ^comments are solely those of the experts and are not to be taken as the 
official position of the State Superintendent of-Education or the Illinois 
State Board of Education. ■ 



+ ^ Topic I : Numeration Concepts 

The test contained one item on Numeration Concepts Table 2 shows the results. 



Table 2. 



Objective 3: * Understa'ndinf Numeration "Concepts < * 

> * * 

Item 61. The length of a box was* measured and found 
to be nine centimeters to- the nearest centimeter . 
Which of these could have been the length of the box 
Measured more accurately? 

a. 10 cm. ^ 

b. 9.9 cm. . teach, est.: 50% 

c. 9.62 pm. ' stu. score: 44% 

d. 9.6 cm. . 

e. 8.6 cm. * / 



Panef comments: ? I tem 61 was the only test item related to numeration 
concepts. It required students to relate a rounded measurement to a possible 
rule rfieasurement. 

*>. • " * ' < 

_j 

Fifty .percent (50%) of the teachers surveyed noted that their' students had 
little or no exposure to this type of item. A correct response required that 
tlie students imagine measuring the length of an object and understand tffe 
concepts of estimation and rounding. The teachers estimated that the item 
would be difficult "for students, and -the sjtudent score approximated the 
teacher estimate. 



• * 

t * - * 



Topic II : Properties of Numbers aac^ Operations , 



There were five-items on this topic. Scores r^ngecl from 62% to ,25%. Tabl 
shows the results^ * . 



_ \Table 3 

V 

Objective 5: Recognition of Facts about .Properties of 
t* Numbers 



Item 34. Which of these numbers is a prime number?* 



a. 21 

b. 22 teach, est.: 67% 

c. 23 stu. scw.e: 62% 

e. 25 



Item 35. Which of the following is true? 



a. 8 < 7 - 

b. 1 < 0. teach, est.: 66% 
c[ -1 < 0 stu* score: $6% 
d. -5 >-4 ' 

,e. -7> 6 



Item 27. Which number is the SMALLEST? 



a. 2:002 

b, 0.202 teach, est.: 70* 
c*. 0.22 stu. score: 51% 
d. 0.022 



Item" 28. In which of ■ these is the ordfer of the 
numbers from smallest to largest? 



a. ft. 99, 31.3, 31.29 

b. 31.29, 30.99, 31.3 teach. e&.: 67%; 

c. 31.29, 31.3, 30.99 stu. score: ,41% 

d. 31.3, 31.29, 30.99 

e. 30.99. 31.29, 31.3 
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Objective 6: Computation Regarding Properties of. 

/ , Numbers , «. ' 

Item 31. Which of these fractions Is the LARGEST? *' ' 



a. . 2/3 

b. "3/4 * teach, est. 4 : 6 656 
£. 4/5 stu. scorer 

t. — m 

e. 6/10* " 




ftaViel' comments : Four items measured objective 5 % One item related to prime 
numbers and three items tested student ability to" order integers or decimals. 
As noted in Chapter 4, the student average score for objective 5 (52% Correct) 
was significantly lower than. the teacher estimate (68% correct). 

Interpretations of the results should take the following into account: 
commonly used textbooks and test$ do not contain question's like HEP items 27, 
28, and 35; those items are mone difficult to solve than they appear to be on' 
a first reading; several response choices are close, and 'visual discrimination^ 
may have been a fomplicating^&actor. * 

On items related to the ordering of numbers, the Student score was higher for 
ordering integers th§m for ordering decimals and fractions. Item 31 related 
to the ordering of fractions. Th£ student score was considerably lower than 
the teacher estimate, which suggests that students have difficulty with such 
items. Interpretations should observe the- cautions listed above. * 

Considerably more -d£ta are needed to understand where the students tiaa greater 
and lesser difficulties. The data gave rise to several questions. 'Do 
students understand the value of invisible zeroes after the decimal pofnt? Do 
thtfy understand the concept of larger and smaller fractions? Do they hav^the 
skil.ls nectssacy.to change fractions to a common scale for comparisons? 



Topic III : - Numbers 



This topic Includes the subtopics whole numbers, fractions, decimals, 
percents, and ratlonals. The subtopics are treated 1n that order. 

Whole Numbers • ' 

Three Items measured wttole numbers. All were computation items, 'Table 
shows thp results. . 



TaW6 4 



Objective 10: Computation with Whole Numbers 



~4N 



Item ,38. What is the SMALLEST positive number 'that**, 
can be divided by 6, 9, and 12 without-a remainder? 



a. 18 

b. 24 teach, est.: 69% 

c. 36 stu. score: 73% 



Item 25. 3(2+7)= 
a. 6 

b; 12 Jfr teach, est.: 75% 



c. 13 " "• stu. score: 63%- 

d. 23 ■ 

e. 27 



Item 39. 43 



a. 12 • ' / 

t. 24 teach, est.: 63% 

c. 48 stu? score: 5^% 



d.. 64 
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Panel comments : The student average score for objective 10 (6455 correct) 
approximated th'e>teacher mean estimate (69% corrett)/ 

Seventy- three percent (73%y of the students appear to be able to perfQrm basic 
multiplication and division skills. A smaller percentage (63%), seem to have * 
learned the mathematical convention of omitting the multiplication sign before 
parentheses and the rules for order of operations, A lower number (55%) ; 
indicated an understanding of tfrirmeaning of exponents*. - ' r 



Fractions , 

The test contained two item? on fractions.' Jdbje 5 shows the results. 

% 



Table 5 



Objective 14: Computation with Fractions 



Item 33. . 1/2 x 1/4 = 



a. 1/6 

b. 1/8 

c. 2/6 

d. 2/8 



•teach. est.: 82% 
stu. score: 77% 



Item 32; 1 2/5 - 1/2 = 



a. 
b. 



2/3 
9/10 



c. 1 1/10 

d. L 1/7 

e. 1 1/3 



teach, est.: 67% 
stu. score: 51% 



Panel comments : Two; items are insufficient to measure an 
the fact that the. student average spor^_^ox-J3We<ttve - 10~ _ (64% correct) was 
lower than the teacherjw2ajd_je&*4iire^^ suggests that a future , 

investi^ationj3f^i*3CtTb^should be considered; Item results point to the 
po^sjM4tty™at while most of the students (77%) had learned the rule for 
multiplication of fractions, fewer (51%). were able to subtract fractions. It 
was noted that the subtraction item is. .considerably more difficult than it 
appears at first glance. A correct response-required several thought 
processes and some difficult steps, including the troublesome process of 
regrouping. 



-10- 



16 



Decimals 



Thfere were >wo items on decimals* Table 6 shows the results. 



TABLE 6 



Objective 18: Computation with Decimals 

Item 24. 11.09 - 8.53 = . « 

a. 2.06 

b. 2.56 teach, est.: 87% 
c'. 3.06 " stu. score: 85% 

d. ' 3.53 - 

e. 3.56 



Item' .26, .004 )24.56 

In the division above, the correct answer is: 



1 

/- 



a. 
b. 

c'. 



.614 
6.14 
61.4 



d. 614 

e. 6140 



teach.. est.: $7% 
stu. s^ore: 56% 



Panel comments: 



lent average score for objective 18 (71% correct) 



approainatetrthe teacher mean gstimaj;'e, (77# correct) . Student scores were 

I^Rerfor the subtraction item than 'for the division item. However, there is 
some question as to what the Item^jiwolving division tested. DJd it test 
division or "student ability to place a decimal point correctly, when the 
division problem Involved decimals?" -*» 



Percent - 

The test conta'ineaVone item , on percent..' .Table 7 shows the/results. 



Table 7 

Objective 22: Computation with Pfercents 



Item 29. 45% of 180 f is 



a„ 45> 

b. 90 

c. 81 

d. 180 



teach, est.: 62% 
stu. score: 55% 



Panel comments : For the one Item related to objective 22, the student score 
approximated the teacher estimate. Several cautions about interpretation are 
in order. One item does not measure an objective. Percent is in the last 
chapter of the more commonly used .textbooks, and experience indicates that 
many teachers do not emphasize it. Eighteen percent (18%) of the teachers 
Surveyed reported that their students had little or no classroom exposure to, 
percent. 



is 



f 


Integers 


\ 




There were three items on integers. Two items were on computation, and one 
was on problem solving. Table 8 shows the results. 






Table 8 






Objective 26: Computation with Integers 






T 4- 07 07 • 0 — 
1 tem 0/ • -CI — 0 - 




• 


•a." -9 

b. 3 . teach, est.: 65% 

c. +9 stu. score: 79% 

d. -3 

m 






Item 36. -2 x 12 = 

* 


• 


V 

\ 


* - 
a OA 

b. -24, teach, est.: 67% 

c. 14 stu. score: 73% 

d. 6 • . 






Ohiprtivp Prnfalwri ^nlvinn with Tnfpnpr^ 
/ 


\ 


ft. 

• 


Item 48. The air temperature on the ground is 31 

degrees. On top of a nearby mountain tjje temperature 

is -7 degrees.. How many degrees difference is there ^ 

oetween tnese two temperatures* v * 

, as 






a. 24 degrees • 

b. -.4 3/7 degrees te^i. est.: 62%,, 

c. 31 degrees • stu/ score: 51% ^ 

d. 38 degrees ' * % . 

V «. * 


• 




** • ' • 


* 

, eric 


1 

1 

♦ * 


.19 

- * 






* 



Pa^ieT comments : For the two items related W objective 26, the student 
average score* (76% Correct) approximated the teacher mean estimate (66% • 
correct). Student performance also approximated the teacher estimate for 
objective 28. ,The student scores were higher for the two "Items related to • 
computation than for the item related to problem solving. Items 36 and 48 
were in the 1978 test. The student score was 65% correct in 1978 and 73% 
correct in 1979 for item 36, 42% correct in 1978 and 51% correct in 1979 Tor 
item 48. A variation of item 37 was- on the 1978 test. The 1978 item ' 
contained' two negative numbers (-27 -f- -3); the 1979 item contained only one 
negative number f-27-r 3). Fortyvfour percent (44%) of the students answered 
the "douhle negative" item correctly in 1978, while 79% of the students 
answered the "single negative" item correctly in 1979. ^ Several questions are 
suggested by these results. Did the students learn one or more rules about 
integers,- but not all of them? Did students understand the concepts of 
integers? Did a number of students learn the rules for computing with 
integers, yet remain unable to conceptualize and solve problems posed in story" 
-form? 



0' 



b 



20 

« -14- 



Rational Numbers ^ - 

The test contained two items on rational numbers. Table 9 shows the results. 

Table 9 - 



Objective 29: Recognition of Facts about Rational 
Numbers 



ftem 30. 1/5, is equivalent to what percent?' 

a. .'15% ' 

b. -5% teach, est. 63% 
. c. 20% stu. score: 52% 

d. 25% 

V 

Objective 32: Problem Solving with Rational Numbers 



Item 44. A map gf the state is to be drawn so that 
•one-'fourth inch represents five miles. If. the real 
distance between two points in. the state is 20 miles, 
how many inches apart should these two points be on 
the map? 



a; " 1/2 irfch" . 

b. 3/4 inch * teach, est.: 58% 

c. 1 inch - • stu. scfcre: 51% 
d; 1 1/4 inch 



Panel comments : Although the student score for the' item, related to objective 
.29 was lower than the 'teacher estimate, caution must be observed. There was 
onTy one item, and"14% of t"he teachers reported little or no classroom 
exposure for, their students to.such content., However,- 48% of the students did 
riot choose the correct answer, and several questions are, suggested by this 
result. Did students understand- the relationships among fractions, decimals; 
and percents? Did they know the process for changing fractions'-first to 
decimals and then to percents? Were the student errors due more to lack of 
knowledge or to lack .of practice? * - , 



The stiideht SQore approximated the teacher estimate for the Item related to 
objective 32. Forty-one percent of the teachers reported little or no 
classroom exposure to. this type of Item for, their students, and 49% of the 
students* did not answer- the item correctly.^ Sincere item was relevant 
everyday life, where was the difficulty? Did students have trouble 
visualizing the problem, setting up the equation, or computing the answer? 



to 



Topic IV:' Measurement 



The test contained nine items on this topjc. Four items measured recognition 
of measurement facti, two items were on computation, and three items tested 
problem' solving. Table 10 shows the results. 



r 
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V 
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Table 10 * 



Objective 37: Recagnitioff of Measurement Faofcs 



Item. 62. An angle may be measured in units c#Iled 



a. centimeters.. 

b. degrees' . teach, est.: 86X 

c. grams. stu. score: ■ 79% 

d. inches. . * 



f 

Item 54. In the United States, we usually buy • 
potatoes by the pound* In Germany, where the metric 
system is used, people buy potatoes by the 

' ✓ % 

a, meterv- 

• b. liter, teach, est,: 70X 

c. pound, stu* score: 77% 

d, kilogram . 



Item 53. In the United States, we usually buy 
gasolin6 by the gallon. In France, where the metric 
system is used, people buy gasoline by the 
^\ 

' a. .meter. 

1 b. liter . • • teach, est.: 70% 

c. quart. , " stu. score: 76X 

d. gram. 



Item 55. The number of centimeters in one meter is 



a. 1/100. , > 

b. lb. . teach, est.: 70% 

c. 100. stu. score: 59% 
T. — ToT50\ 



~ Table 10 (continued) 
Objective 38: Computation in Measurement; 



Item 57. About how long is the paperclip above the* 
metric ruler? v 




|lll i |i.iijiti)jtni|'iii|iii.|iiii|h^ 

Ocm 1 ' 2 3 < 5 6 7 8 9 10 



-a. 30 mm 

V. 3a cm teach, est.: 70% 

c. 3 m stiii.. score:' 50% 

-d. 33* km 



Item 56, 2 meters + 3 millimeters =. 



a. 2.0003 meters 

b. 2.003 meters teach, est.: 52% 
cl 2.03 metet^ stu. score: '39% 

d. 2.3 meters 

e. "5 meters*" 



Objective 40: Problem Solving 1n Measurement 



Item 58. A 15 centimeter piece is cut from a stick 
one meter long. What is the length of the remaining 
piece? • 



a. 85 cm 

115 cm teach, est.: 64% 

c. 985 cm stir, score: 70% 

d. 1015 cm 

e. 9985 cn^ 



Item 59. A car takes !5U\1nutes to travel ten 
kilometers. What is l^he speed of the car? 



-a. 30 kilometers per hour 

b. 40 kilometers per hour 

~cl 60 kilometers per hour 

d. 90 kilometers per hour 

et. 150 kilometers DPr hour^r 



teach, est.: 53% 
stu. score: 32% 



Item 65." The measure of the smal 1 er ,angl e formed by 
the two* hands of a clock at 4 o'clock is 



a. 30 degrees. * 

b. 45 degrees. - — .-• teach, est.: 49% 

c. 60 degrees. stu. score: 32% 



d. 90 degrees. 

e. 120 degrees . 



Panel comments : As mentioned in chapter two, there was no s-ignificant 
difference between the student average score for objective 3/ • 
(73% correct) and .the. tea'cher mean estimate (74% correct). There were only 
two items related to objective 38, and the student average score (44% 
correct) was lower than the' teacher mean estimate (61% correct). 

v - " . 

Regarding recognition of basic measurement facts (objective 37), 89% of the 
teachers reported tbat their students had s be'en exposed to the material 
tested. In contrast, 37% of the teachers stated that students had minimal 
or no classroom exposure to the HEP items related to objective 38. The. 
results give rise to two major questions. Were the student mi-st^kes mainly 
-due to lack of -knowledge of some basic' measurement facts, or the\lack or 
skill in converting from one unit to another? M\ » - 

As reported in Chapter 4, the student average score for the Items measuring 
objective 40 (45% correct) was not significantly different from, the teacher 
mean estimate (55% correct). Interpretations of the data, should take into 
account the lack of experience students had with such material. Little or 
no exposure was reported by 23% of the teachers for item 58, and 43% for 
items 59 and «5. The results suggest several questions. Were mistakes due 
mainly to lack of exposure? Was lack of factual knowledge a major factor- 
leading to mistakes? Should students be exposed to this material prior to 
high school? • • 
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Topic V : Algebra • 

There were two items on this topic. ^Both tfere\on computation. Table 11 . 
shows the results. * 



Table 11 



Objective 42; Computation in Algebra 



Item -40. If x is replaced- by 3, then the value of 
x 2 -l is * 



i r* 



a. 8 

FTTT 

c. 5 

d. ' 2 



teach. es*t.: 50% 
stu. score: 49% 



Item 41 



a. 15 

b. 5 

c: * 

<j: 9 



Solve the .following equation: 3x-3=12. x= 



/>v teach^est.: 53% 

V ' stu. .score: 50% 



V 



Panel comments : interpretations of the results should take several factors 
into account. .There were only two items concerning algebra, and both' related 
to objective 42.* The student average score (50% 'correct) was nearly identical 
to the teacher mtfan estimate (52% correct). Thirty-nine percent (39%) of the 
teachers reported that students had 'receive! 5 "! ittle or no classroom e'xposure 
to the material tested by the items. "Both items' required knowledge of basiic - 
algebraic concepts and more than one step for a correct soJJUt1on\ N The use of 
exponents, algebraic symbols, and general processes for sotving- equations 
posed difficulties for the typical 8th grade student. '' 



] ERLC 
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Topic VI ; Geometry 



The test contained three items on this topic. Two items were on recognition 
of geometry facts, and one was on problem solving. Table 12 shows the results, 



Table 12 



Objective 45: Recognition of Basic Geometry Facts 



Item 64. Angle A is what kind of angle? 

A 




teach, est.: 76%. 
T stu. score: 64% 



a. Acute 
* b. Right 
v q. Oblique 1 



Itjgm 63'. Whidh line segment is a diameter of the 
circle with center N? 



E H ^ 



a. NP 

b- HM 

c. EG 

d. HK 





N \ 















teach, est.: 76% 
p " stu. score: 63% 



Objective 48:. Problem Solving in Geometry 



j 



Item 66* In a given triangle, the measures of two of 
the angles are 35 degrees and 75 degrees. The measure 
of*the third angle^is: 



a. 40 degrees. 

b. 55 degrees. 

c. 7Q degrees . 

d. 95 degrees. 

e. 110 degrees. 



teach, est.: 57% 
stu. score: 38% 



M 
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Panel comments ; The student average score for objective 45 (64% correct) was 
lower than the teacher mean estimate {76% correct). The Items tested students 
on the definitions of right angle £nd diameter. Ninety-two percent (92%) of 
the teachers reported that students had been exposed to the material; $Q% 
described the exposure as adequate to heefvy. Only one Item was related to 
objective 48, and the sti^dent score was lower than the teacher estimate. 
Interpretation of. the data should take Into account that the item required 
knowledge that the sum of the interior angles of a triangle is 180°. % * 
Forty-seven percent <47<) of the teachers reported that thftir students had 
received little or Ho classroom exposure to that knowledge. 



Topic VII; Probability and Statistics 
The test contained nojtems specifically related -to this, topid. 



Topic VIII ; Personal and Consumer Mathematics 



There were eleven items on this topic. One item was on computation, and ten 
items measured probTem-soTving ability in consumer situations. Tables 13 and 
14 show the results. 



Table43 



Obj'ective 54: Computation in Consumer Mathematics 



r 



Item 23. Add: $3.06 
$10.00 
$9.14 ' 
$5.10 



a. $2730 . . 

b. $7.20 ■ teach, est.: 9255*' - 

c. $17.30 - stu. score: 76% 

d. $27.20 
6. $27.30 



Panel comments : On the item related to objective 54 the student score was 
lower than the teacher estimate. The item seemed straightforward and 
uncomplicated.* However, 1355 of the students chose wrong response "a." They 
apparently added the numerals correctly, saw that the numerals of "a" were 
correct, and selected it, ignoring the decimal point. 
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Table 14 *^ 



Objective 56: ProbleiF Solving in Consumer 
Mathematics . * 



Item 49. A sports* car owner says that the car gets 22 
miles pier gallon gf gasoline. How many miles could 
the car go on seven gallons of gasoline? 



a. 154 miles 

b. 144 miles teach, est.: 76% 

c. 134 miles . stu. score:. 86% 

d. 124 miles' • 



Item 45. Ruth D has savings, of $17.25. She wants to 
buy the following things: skirt - $9.00, belt - 
$3.00, book - $2.50, records - $4.98. How much more 
money does she need before she can buy all of these 
items? (Do not include sales tax in yo\jr answer). 



, a. $1.73 9 - 

b. $2.03 ' teach, est.: 72% 

c. $2.13 ° stu. score: 81% 

d. $2.23 



Item*50. If John drives at an average speed of 50 
J Wiles per hour, how many hours will 1t take him to 
drive 275 nrtles? 



a£ 6 hours 

b. 6 1/2 hours teach, est.: 69% 

c. 5 hours stu. score: 65% 

d. 5 1/2 hours' 



Item 46. Television sets are on sale at two stores. 
One offers a ten percent discount whil* the other 
offers 15 percent. What is the difference In the sale 
price at the two stores of a TV set that is regularly 
priced at $100? 



a. $5 

b. $10 4 teach, est,: 58%, 

c. *15 stu. score: 62% 

d. $20 
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Table 14 (continued) 



'Item 43. John's parents bought a refrigerator for 
$375, If they pay $20 per month for two years, how 
much more than $375 will -the refrigerator cost them? 



-au >$95 

b. $105 * teach, est,: 60% 

c 5200 s stu, score: 60% 

d. $375. 



Item 47. Mr. Simmons put a wire fence all the way 
Around his rectangular* garden. The'garden 1s nine 
feet long and five feet wide. How many feet of 
fencing did he use? 



a. 20 feet . 

b. 28 feet teach, est.:- 70% 
~cl 14 feet stu. score: 52% 
d. 36 feet 3 



Item'42. A discount of 15% was given during a sale. 
What 1s the discount on gpods valued at $280? 



a. $ 15 " r 

b. $ 28 teach. est.T 56% 

c. $ 42 # stu, score: 43% 

d. $238 

e. $265 ; 



Item 51. Last summer Todd earned $205, Charlotte 
earned $662, and Dale e&rned $400, The average of 
their summer incomes was: * 



a. $1167, 

b. $583,50, . . teach. e$t.: 661 

c. ^400, • stu. score: 44% 

d. *389. 



Item 52. A team scores two goals 1n each of its -first 
five games and five goals in its sixth game. The 
average number of goals per game over the six games 
was : 



a. l v 2/3 

b. 2 1/6 teach, est,-: 53% 
c* I 1/2 o stu, score: 41fc 
<H * * * ' 
e. 3 1/2 

-24- • - 



Item 60. A can of gasoline holds nine liters. " A 
larger can 1s exactly twice as long, twice as wide, 
and twice as high as the original can.. That larger 
can will hold * 



a. 18 liters. 

b. * 36 liters. teach. ^st f : 35% 
c 54 liters. stu. score: 14% 

d. 72 liters . ' 

e. 324 liters. 



Panel comments' : Objective 56 was measured by ten items. 'As mentioned .in 
Chapter 4,. the student average score for the objective (55% correct) was not 
significantly different from "the teacher mean estimate (61% correct). 

Students scored higher on items 45 and 49 (average score 84% correct) than on 
the remaining eight jtems measuring objective 56. Were there any 
distinguishing characteristics? Panel discussion led to several observations 
which might be explored in th> future. Item 49 was a one-step multiplication 
problem; item 45 required only simple addition and subtraction. Both items N 
dealt with simple concepts, were relevent to everyday experience, could" be 
solved in one or two steps and used only who.le numbers or dollars and cents. 

There were two observations about items 43 and 50. Item *50 required division, 
while item 43 required multiple steps. Twenty percent (20%) of the teachers 
reported that their students had received' little or no exposure to these types 
of items. , 

Several observations and questions arose regarding the datfc on perimeter, 
percent, and 'average (items 42, 47, and 51). Eighty-^ev€n\percent (87%)' of 
the teachers reported that their Students had received adequate to heavy 
classroom exposure to the perimeter item. The question arose as to why 'so 
many students answered the item incorrectly 4f they had received adequate 
exposure to such material. Twenty-eight percent (28%) of the teachers 
reported that their students' had received little or nb exposure to percent 
problems like item 42. That\data gave rise to several questions. Isn't 
percent- an important part of [everyday life? "Shouldn't almost all eighth * 
graders receive considerable exposure to percent? What do students know about 
percent? What should they know? What difficulties are they having? Item 46 
was also related to percent, but the correct answer ($5) could have been 
obtained by .subtracting 10% from 15%. Students could have obtained the 
correct answer for the wrong reasons. 



Thirty percent (30%) of the teachers reported that their students* had received 
little or no exposure to the concept "average*" The question arose as to 
whether students shouldn't have some exposure by eighth grade. • 

Finally, the student score (14% correct) was considerably lower than the 
teacher estimate (35% correct) for item 60 which tested students on , 
comparative capacities of different size containers. Several cautions are in 
order regarding 'interpretation- of that result." The data related to only one 
item. Sixty-five percent (65%) of the teachers reported that their" students 
had received little or no exposure to the material tested by the item. 
Capacity is a difficult concept tq grasp.. Comparisons among 'different . 
capacities are far more difficult than comparisons of length or weight. 

Discussion by the panel regarding the results for objective 56 suggested that 
as the items became more complex according to certain dimensions, the student 
scores became lower. Several dimensions 'were suggested as ones which might be" 
investigated: concept difficulty, .relevance to everyday life, types of 
numbers, complexity of process, and type of computation^. 




Chapter 3 
Discussion of the Results . 



The mathematics panel was asked to study all data available from 'the 
Illinois Inventory of Educational Progress, The data included test results 
from. 1976, 1978,- and 1979; responses to teacHer and principal surveys;, and a 
survey of mathematics curricula. The paftel was asked to give their overall 
reflections 'oh the result^ of \the 1979 eighth grade HEP, taking into 
accountthe data and their experience in the field of mathematics 
education. Thje comments of this chapter are a distillation of the panel's 
reflections. 

The test items on Topjc/Il (Properties of Numbers) contain difficulties not 
usually noticed on a first reading. Nevertheless, the teacher survey 
indicated that the students had received considerable exposure to the topic, 
*and student performance must be considered disappointing. More than half 
the students could not order decimals* correctly, and three-fourtps of the 
students could not order fractions correctly. 

Student scores for Topic III (Numbers) and. its subtopics were not 
significantly different from the* teacher estimates. However, logical 
comparisons among the items and item results raisecj several questions* The 
items on whole numbers seemed conceptually and procedurally more difficult 
than other items. Yet, students did about as well on the Whole dumber items 
as on other Mtems. The items on decimals, fractions, and percent appeared 
to be easy, but from one-third .to one-tialf of the students^f ailed to obtain 
.the correct answers. On one problem, 13% percent of the -suTdents added 
approximately $3, $£, $9, and $10 and came up with a sum of over twd^ 
thousand^ dollars . Students must be impressed* with the need to checJT their 
answers to make sure that they are reasonable and sensible. Although there 
was only one item 6n percent, it was conceptually easy. It was of real 
concern that almost half the .-students got it wrong. Eighth grade students 
should be able to change a percent to a decimal and do decimal 
multiplication. 

A number, of measurement items on metric units were/tested in 1976, 1978, and 
19 7 9. Studerrtr scores were higher on each succeeding test. However, there 
is still 'room for improvement.* All students should know basic measurement 
facts and relationships. Student ability to do problem solving in 
measurement was disappointing. The problems required computation skills to 
firfd.the area of a room, the volume of a box, and the average speed of -a 
vehicle. Less than half the students were able to solve thejse problems 
correctly. * 

Given the limited exposure of eighth grade students to algebra and geometry 
(as reported in the teacher, survey), student performance was quite good* 
However, many students do not take basic algebra or geometry even in high 
school jas indicated, by The Illinois Census 'of Secondary School Course 
' Offerings {1977 )1 conducted' by the HI inoiX State Board of Education. 
Stgdents who do not take algebra and geometry will find many opportunities 
for further education closed to them. * . ; 



,\ The Illinois Census of. Secondary School Course Offerings . Springfield, 
Illinois 62777: Illinois State Board of Education, 1977. 

*" - . 
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The. students were able to recall mathematics which they had learned and to 
_do. computations whi*ch were clearly indicated. However, for all topics, they 
were less able to apply previously acquired knowledge to new- or unfamiliar * 
situations. This inability" is of particular concern since problem solving 
is required frequently in everyday li,fe, as well as in further education. 
It is important for students to le'arn to visualize problems and work out 
correct solutions. ' 

The 1979 Illinois Inventory of Educational Progress has" provided some, 
initial data about the mathematics -achievement of eighth grade students in 
Illinois. The data have stimulated many questions. These questions can be 
utilized to develop hypotheses and gather data in the future in an attempt 
to learn more about student achievement and i*s possible improvement. 



X 



Chapter- 4 



Factor Analysis Results 



The IIEP was first administered in 1976. a Results from the test gave base , 
line data regarding mathematics achievement. In 1978, the objectives were 
revised \in- terms that were mofe easily' understood and more amenable to . 
research *on learning processes as they occur in students. Results.were 
.subjected to factor analysis, a statistical* procedure which helps identify 
stident. abilities and strategies used in learning.. 

Factor analysis is a highly technical mathematical and statistical procedure 
whirh cannot be fullyexplained here. However, an intuitive understanding 
of factors and their. derivation is possible. . Ffed Kerlinger, in his book 
Foundations of Behavioral Research (1973) wrote: 

Factor analysis is a method for determining the number and nature of the 
underlying variables among large, numbers of measures. 

- Generally speaking, if two tests measure the same thing, -the scores 
obta-ined from them can be added together. If, on the other hand, thg 
two tests do not measure the same thing, their scores cannot be added 
together. Factor analysis tells us, in effect, what^tests ,or measures 
' can be added and studied together rather than separately. It thus - 
limits the variables .with which the scientist must cope. It also 
(hopefully) helps the scientist to locate and identify umtias or 
fundamental propertiesr^aderlying tests and measures. 

A factor is a construct, i hypothetical entity that is assumed to '. < 
underlie tests and test performance. A number of factors have been 
found to underlie intelligence, for example: verbal ability, numerical 
' ability, abstract reasoning, spatial reaslHtog, and memory. 

% - A HYPOTHETICAL EXAMPLE 

Suppose we administer six tests to a large number of seventh gr'ade 
pupils. We suspect that the six tilts are not measuring six, -but some 
smaller number of variables. The tests are: vocabulary, reading, , *• 
synonyms, numbers, arithmetic (standardized tests), and arithmetic • 
(teacher-made tests). The names of these tests indicate their nature. 
* WeUabel them respectively, tf, R, S^, N, AS, AT. (The last two tests, 
though both arithmetic, have different contents and reliabilities. We 
assume a good- reason for including them both, in a test- battery. ) After 
the tests are administered and scored, coefficients of correlation are 
computed between each -test and every other test. We lay out the r s in 
* #correlation matrix (usually called R matrix). The" matrix is given in- 
Table 37.1 (Table 15). * ■ . / 
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Table- 15-' 



TABLE 37.1 R MATRIX: COEFFICIENTS OF CORRELATION AMONG SIX TESTS 



Cluster I 





V 


R 


s 


N 


• AS 


AT 


V * 




' 7t2 




\ .09^ 


.09 


.00 


R / 






.57 ' 


/ .15 c 


.16 


.09 


s \ 


.63 


.57 




.14 


.15 


.09 


N * . 


.D9 


.15 


.14 




^!57 


^63" 


AS. 


.09 


.16 


.15 / 


^<57 




.72 


AT* 


.00 " 


.09 


.09 \ 


.63 










* 






Cluster II 





XT 



'.•.How many underlying variables or factors are there? .% .The 
factors are presumed to be underlying unities between ttie test * 
performances. They are reflected in the correlation coefficients, 
If two or nore tests are substantially correlated, then the tests 
*share variance. They have common factor parlance. They are 
measuring something ip common. 



r's 



...Threre are two factors. This is indicated by t&e clusters of 
circled and labeled I and II in Table 37.1. Note that V correlates 
with R,.72; V with S,v63; and R with°S..57. V, R, and S appear to 
be measuring something in comrfion. It isjSmportant to note, 
however, that the tests in Cluster I, though themselves 
intercorrelat&d, are not to any great extent correlated with the 
tests in Cluster II. 'Likewise, t N, AS, and AT, though themselves 
intercorrelated, are nQt substantially correlated-with the tests V, 
R, and S. What -is measured in common by the .tests in Cluster^ I is 
evidently riot the same as what is measured nrf- common by the tests 
in Cluster II. There appear to be two clusters or factors in the 
matrix, (pp. ,659-661) £ . ^ 



For further discussion of factor analysis, see Kerlinger (4973) pp. 
and cited references. * , 



659-692 



2 Fred N. Kerlinger.. 
Edition). New York: 



Foundations of Behavioral Research (Second 
Holt, Rlnehart, and Winston, Inc., 1973. 
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Inferential Results of the HEP 



The first hypothesis stated that there would be three ability factors. The 
second hypothesis stated that there would be five topic factors. The data 
showed two ability factors and no topic factors. 



Factor I 



The abilities of recognition and computation both loaded on the first 
factor. Comparisons among the items indicated that the items were measuring 
learned material about which students usually receive instruction, practice, 
and guidance. Hypothesis 3. stated that teacher estimates would be higher 
than the student scores, which turned out to be the case for Factor I. 
Table 16 shows the results. 



Table 16 





Factor I: 

* 


Learned Material 


> 


1 

Objective 


• 

Item 


Teacher 


Student 




Estimate 


Performance 


- • 

5- 


' 27 


■70% 


51% 




. 28 


67% • 


- . 41% 




' 34 . 


67% 


62% ' 




35 


66% 


56% 


10' 


25 


75% 


63% 


38 


69% 


73% 




39 


63% 


55% 


14 


32 


67% 


51% 




33 


82% 


77% 


18 


24 


87% 


85% 


26 


67% 


56% 


42 


40 . 


-50% 


49% 


41 


53% 


50% 



Mean . .68 ,59 

Standard .Deviation .10 .13 

N 13 13 

s. 

t = 1.98* df = 24 

^significant p< .05 



Factor U 



Factor II was comprised of items which appeared to measure problem-solving t 
ability in mathematics* The items required students to determine the nature 
of the problem and the processes needed to solve it* .The ability required 
ntare than simple recall and application of learned steps. The hypothesis 
that teacher estimates would.be higher than student scores was not./ 
supported. The estimates were higher, but the difference was not 
statistically significant. Table 17 shows the results. 



Table 17 



Factor II: Problem Solving 



, Objective 'Item Teacher Student 

- Estimate Performance 



6 


3*1 ■ 


66% 


25% 


28 


' 48 


62% 


51% 










32 


, " 44 


. c 58% 


51% 


56 


42 


56% 


43% 




43 


60% 


60% 




45 


72% ' 


81% 




46 


58% 


62% 


< 


47 


70% 


52% 




49 


76% 


. 86% 




- 50 


69% 


65% 




51 . 


66% 


44% 




52 


53% 


41% 




60 


35% 


14% 



Mean » .62 .51 

. S'TattTard Deviation , * .10 .20 

N 13 13 



t = 1.55 df = 24, 

+N.S. * 



* Results for Specific Objectives- " 

The eighth grade HEP measured five objectives, I.e., objectives containing 
3 or more Items. The hypothesis stated that teacher estimates would be 
higher than student scores. Although the teacher estimates were higher than 
student scores for all objectives', the difference was statistically 
significant for objective 5 only. Table 18 shows the results. 
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Table 18 



Mean Teacher Estimates and St.udent Scdres 
for Specific Objectives 



Teacher Estimates Student Scores T-test 



Factor Objective 


Mean 


S.D 


N 


-Mean 


S.D. 


N 


Results 


df 


I 5 


68% 


.02 


4 


52% 


.01 


4 


3.42* 


6 


r ^ io 


69% 


.06 


3 


64% 


.09 


3 


.856+ 


4 


II. 56 


61% 


.11 


• 10 


55%" 


.21 


10 


^.820+ . 


18 


Not Loading 37 
on a Factor 


74% 


.08 


- 4 


' " 73% 


.09 


•4 


,.168+ 


6 


Not Loading 40 


55% 


.07 


3 


• 45%- 


.21 


3 


.775+ 


4 



on a Factor 



* significant p < .01 
+ N.S. 
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APPENDIX A : 

.index of Mathematics objectives "r 

FOR THE 1979 EIGHTH 'GRADE' HEP 



Objective Item 



Page 



APPENDIXa-B 

INDEX OF MATHEMATICS. ITEMS 
F'OR THE 1979 EIGHTH GRADE 
MAJHEMATICS HEP 



Item 



Objective Page 



. 3 


61 


• 6 




f 54 


22 


5 


27 


- 7 


24 


{ 25 ' 
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